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VIRTUAL RESOURCE ID MAPPING 

Inventors: Burton Hipp, Rajeev Bharadhwaj, William C. Romans, Yuh-Yen Yeh 

REFERENCE TO RELATED APPLICATIONS 
The present application claims priority to and incorporates the following applications by 
reference: DYNAMIC SYMBOLIC LINK RESOLUTION, Prov. No. 60/157,728, filed on 
October 5, 1999; SNAPSHOT VIRTUAL TEMPLATING, Prov. No. 60/157,728, filed on 
October 5, 1999; SNAPSHOT RESTORE OF APPLICATION CHAINS AND 
APPLICATIONS, Prov. No. 60/157,833, filed on October 5, 1999; VIRTUAL RESOURCE-ID 
MAPPING, Prov. No. 60/157,727, filed on October 5, 1999; and VIRTUAL PORT 
MULTIPLEXING, Prov. No. 60/157,834, filed on October 5, 1999. 

FIELD OF THE INVENTION 
The present invention relates broadly to computer networks. Specifically, the present 
invention relates to adaptively scheduling applications on-demand onto computers in a computer 
network. More specifically, the present invention relates to making a snapshot image of a 
running application including data and state information, and restoring a running application 
from the snapshot image. 

BACKGROUND 

Global computer networks such as the Internet have allowed electronic commerce ("e- 
commerce") to flourish to a point where a large number of customers purchase goods and 
services over websites operated by online merchants. Because the Internet provides an effective 
medium to reach this large customer base, online merchants who are new to the e-commerce 
marketplace are often flooded with high customer traffic from the moment their websites are 
rolled out. In order to effectively serve customers, online merchants are charged with the same 
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responsibility as conventional merchants: they must provide quality service to customers in a 
timely manner. Often, insufficient computing resources are the cause of a processing bottleneck 
that results in customer frustration and loss of sales. This phenomena has resulted in the need for 
a new utility: leasable on-demand computing infrastructure. Previous attempts at providing 
5 computing resources have entailed leasing large blocks of storage and processing power. 

However, for a new online merchant having no baseline from which to judge customer traffic 
upon rollout, this approach is inefficient. Either too much computing resources are leased, 
depriving a start up merchant of financial resources that are needed elsewhere in the operation, or 
not enough resources are leased, and a bottleneck occurs. 
10 To make an on-demand computer infrastructure possible, computer applications must be 

ported across computer networks to different processing locations. However, this approach is 
costly in terms of overhead for the applications to be moved across the network must be saved, 

Q shut down, stored, ported and then restored and re-initialized with the previously running data. 

VI The overhead is prohibitive and negates any performance improvements realized by transferring 
1513 the application to another computer. Thus, there remains a heartfelt need for a system and 

r n method for effecting a transfer of applications across computer networks without incurring costly 

: - y processing overhead. 

pJ SUMMARY OF THE INVENTION 

20 ^} The present invention solves the problems described above by providing virtual mapping 

p of system resource identifiers in use by a software application for the purpose of making the 
running state of an application node independent. By adding a layer of indirection between the 
application and the resource, new system resources are reallocated and then can be mapped to the 
application's existing resource requirements while it is running, without the application detecting 
25 a failure or change in resource handles. 

This layer of indirection makes the application's system resource identifier (system RID) 
transparent to the application. RID's are usually numeric in form, but can also be alphanumeric. 
RID's are unique to a machine, and can be reused once all claims to a specific RID have been 
given up. Some examples of RID's include process ID's, shared memory ID's, and semaphore 
30 ID's. Only the virtual RID is visible to the application. Conversely, the virtual RID is 
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transparent to the operating system (OS), and only the system RID is visible to the OS. Every 
application has a unique identifier that distinguishes it from every other running application. 
There exists a one to one mapping between the AID: resource type: virtual RID combination and 
the node ID: system RID. Virtual RID's are only required to be unique within their respective 
5 applications, along with their corresponding system RID's may be shared among multiple 

programs and processes that have the same AID. System RID's that have been virtualized are 
accessed through their virtual ID 5 s to ensure consistent states. 

These and many other attendant advantages of the present invention will be understood 
upon reading the following detailed description in conjunction with the drawings. 

10 

BRIEF DESCRIPTION OF THE DRAWINGS 
FIG. 1 is a high level block diagram illustrating the various components of a computer network 
3 used in connection with the present invention; 

1;;: FIG. 2 is a high level block diagram illustrating the various components of a computer used in 
1513 connection with the present invention; 

? fj FIG. 3 illustrates how application state is tracked using library and operating system kernel 
^ interposition; 

M FIG. 4 illustrates the capture of an application's run-time state; 

~;t FIG. 5 is a flow chart illustrating the logical sequence of steps executed to create a snapshot 
20 1 H! image of an application instance; 

p FIG. 6 is a flow chart illustrating the logical sequence of steps executed to restore an application 
instance from a snapshot image.; 

FIG. 7 is an illustration of the format of a snapshot virtual template; 
FIG. 8 is a flowchart illustrating the logical sequence of steps executed to create a snapshot 
25 virtual template; 

FIG. 9 is a flowchart illustrating the logical sequence of steps executed to clone a snapshot 
virtual template; 

FIG. 10 illustrates the registration of an application using virtual resource identifiers; 
FIG. 1 1 illustrates the allocation of a virtual resource; 
30 FIG. 12 illustrates the translation of a virtual resource to a system resource; 
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FIG. 13 illustrates the translation of a system resource to a virtual resource; 

FIG. 14 is a flowchart illustrating the logical sequence of steps executed to create a virtual 

translation table; and 

FIG. 15 is a flowchart illustrating the logical sequence of steps executed to translate a virtual 
5 resource. 



DETAILED DESCRIPTION 

A. Snapshot Restore 

FIG. 1 illustrates in high level block diagram form the overall structure of the present 
10 invention as used in connection with a global computer network 100 such as the Internet. 
Remote users 102-1 and 102-2 can connect through the computer network 100 to a private 
network of computers 106 protected by firewall 104. Computer network 106 is a network 
y comprising computers 150-1, 150-2, through 150-n, where n is the total number of computers in 
^ network 106. Computers 150 are used to run various applications, as well as host web sites for 
15 O access by remote users 102. The present invention is implemented on computer network 106 in 
I f! the form of virtual environments 110-1 and 110-2. While only two virtual environments are 
~ illustrated, it is to be understood that any number of virtual environments may be utilized in 
m connection with the present invention. 

f 5 FIG. 2 illustrates in high level block diagram form a computer that may be utilized in 

20 connection with the present invention. Computer 1 50 incorporates a processor 152 utilizing a 
13 central processing unit (CPU) and supporting integrated circuitry. Memory 154 may include 
RAM and NVRAM such as flash memory, to facilitate storage of software modules executed by 
processor 152, such as application snapshot/restore framework 200. Also included in computer 
150 are keyboard 158, pointing device 160, and monitor 162, which allow a user to interact with 
25 computer 150 during execution of software programs. Mass storage devices such as disk drive 
164 and CD ROM 166 may also be in computer 150 to provide storage for computer programs 
and associated files. Computer 150 may communicate with other computers via modem 168 and 
telephone line 170 to allow the computer 150 to be operated remotely, or utilize files stored at 
different locations. Other media may also be used in place of modem 168 and telephone line 
30 170, such as a direct connection or high speed data line. The components described above may 
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be operatively connected by a communications bus 172. 

FIG. 3 shows how application states are tracked via library and kernel interposition. The 
application snapshot/restore framework 200 is a software module that processes transactions 
between the operating system 206 and the applications 208. Requests for system resources or 
changes to process state are routed internally and the application snapshot/restore framework 200 
tracks these events in anticipation of a snapshot. The application snapshot/restore framework 
200 is transparent to running (and snapshotted) applications. From an application's perspective, 
the application is always running. An application snapshot may consist of multiple processes 
and multiple threads and includes shared resources in use by a process, such as shared memory or 
semaphores. A process may be snapshotted & restored more than once. The computer on which 
a process is restored on must be identically configured and have an identical environment 
(hardware, software, and files) that matches the environment of the computer where the process 
was snapshotted. All processes that are snapshotted together in the form of an application chain 
share the same application ID ("AID"). As used herein, an application chain is the logical 
grouping of a set of applications and processes that communicate with each other and share 
resources to provide a common function. 

The virtual environment 204 is a layer that surrounds application(s) 208 and resides 
between the application and the operating system 206. Resource handles are abstracted to 
present a consistent view to the application although the actual system resource handles may 
change as an application is snapshot/restored more than once. The virtual environment also 
allows multiple applications to compete for the same resources where exclusion would normally 
prohibit such behavior to allow multiple snapshots to coexist without reconfiguration. Preload 
library 214 is an application library that interposes upon an application for the express purpose of 
intercepting and handling library called and system calls. Once the library has been preloaded it 
is attached to the process 5 address space. Preload library 214 interposes between application 208 
and operating system 206. It is distinguished from kernel interposition in that it operates in "user 
mode" (i.e., non-kernel and non-privileged mode). Application 208 can make application 
programming interface (API) calls that modify the state of the application. These calls are made 
from the application 208 to the operating system API interfaces 210 via the application snapshot 
restore framework 200 or the preload library 214. The preload library can save the state of 



various resources by intercepting API interface calls and then saves the state at a pre-arranged 
memory location. When the process 1 memory is saved as part of the snapshot/restore 
mechanism, this state is saved since it resides in memory. The state as it is modified is saved to 
non-volatile storage (i.e. a file on disk). The preload library notify the snapshot/restore 
5 framework through one of its private interface. 

FIG. 4 illustrates the capture of an application's run time state. The OS API interfaces 
210 are standard programming interfaces defined by international standards organizations such as 
XOPEN. The open() system call which allows an application to open a file for reading is an 
example of an API interface. The process management system 216 is a component of the 
10 operating system 206 that allows one process to examine or alter the state of another process. 
The interfaces that are provided by this component are usually not standardized interfaces (not 
part of a recognized standard API) and are OS-implementation dependent. However, such 
y interfaces usually allow access to more state than standardized API interfaces. The run-time 
^ information captured from a process is used by the snapshot driver 218. 
15 £3 An application needs to be snapshotted if it is idle and is not currently in use or there are 

I f| higher priority requests that require the application be scheduled out and preempted in favor of 
another application. A snapshot request is initiated by an application scheduler that determines 
N when an application needs to be restored on-demand and when the application is no longer 
}% needed (can be snapshotted to free up resources). The application scheduler does this based on 
20 web traffic, server load, request response time, and a number of other factors. An application 
p needs to be restored if there is an incoming request (i.e. a web browser request) and the 
application required to handle that request (ie a particular web site) is not currently running. 
Alternatively, an application needs to be restored if there is an incoming request (i.e. a web 
browser request) and the application required to handle that request (ie a particular web site) is 
25 currently overloaded, so another instance of that application is restored to handle that request. 

FIG. 5 illustrates the logical sequence of steps executed by Snapshot driver 218 to make a 
snapshot image of a process. Beginning at step 250, an snapshot image of a runnable application 
is requested. The AID is looked up (decision step 252) in a table in memory 154 containing a list 
of every AID present on computer 150. If the AID is not found control returns at step 254. 
30 However, if the AID is found, control continues to decision step 256 where the snapshot/restore 



6 



framework 200 searches for a process belonging to the application having the matched AID. If a 
process is found, control continues to step 258, where the process is suspended. For a process to 
be snapshotted, it must be completely suspended with no activity present and no ambiguous state 
(i.e., in a transitory state). Since a process may be represented by asynchronous threads of 
5 activity in the operating system that are not formally part of the process state, any activity in the 
operating system that is executing on behalf of the process must be stopped (i.e. disk I/O 
activity). In other words, there may be moments where temporarily a process cannot be 
snapshotted. This is a finite and short period of time, but it can occur. If the state is consistent 
and the threads are quiesced (decision step 260), control loops to step 256 and the remaining 
10 processes belonging to the application are located and suspended. However, if a process is 

located that does not have a consistent state or a thread is not quiesced, suspended processes are 
resumed and the snapshot cannot be completed. 

o Once all related processes are suspended, for each state of each suspended process, the 

state is checked to see if it is virtualized (step 264). A virtualized state is any process state that 
15 u reflects a virtualized resource. If the state is virtualized, it is retrieved at step 266 ; otherwise the 

f ?j non-virtualized state is retrieved at step 268 State retrieval is performed as described above by 
the snapshot driver 218 querying the application snapshot/restore framework 200, operating 

M system API interfaces 210, and process management subsystem 216. If the state has changed 

r 3 since the last snapshot (step 270), the new state is recorded. Control then loops to step 264 and 
20 J; if executes through the above sequence of steps until all states of all processes are checked. Once 

O completed, control proceeds to step 278, the registered global state, such as semaphores, is 

removed. Registered global state is state that is not specifically associated with any one process 
(ie private state). Global state is usually exported (accessible) to all processes and its state can be 
modified (shared) by all processes. Control proceeds to step 280, where the process is 
25 terminated. If there are remaining processes (step 282), these are also terminated. This sequence 
of steps is concluded to create a snapshot image which is stored as a file and made available for 
transmission to another computer within public computer network 100 or private computer 
network 106. 

FIG. 6 illustrates the sequence of steps executed by the restore driver 220 to restore a 
30 snapshot image. The snapshot image is accessed via a shared storage mechanism and a restore 
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call is made at step 300. The restore driver 220 looks up the AID for the snapshot image and 
(decision step 302) if not found control returns and the snapshot image cannot be restored. 
However, if the AID is found, control continues to decision step 304 where, if the snapshotted 
image matching the AID is located, the global/shared state for each process associated with the 
5 snapshot are found. Control then continues to step 308, where remaining global or shared state 
for the processes are recreated. Since global and shared state is not associated with a single 
process and may be referenced by multiple processes, it is created first. Recreating the state 
entails creating a global resource that is functionally identical to the resource at the time of the 
snapshot. For example if during a snapshot, a semaphore with id 5193 is found with a value of 7, 
10 then to recreate the state at restore time a new semaphore must be created having the exact same 
ID as before (ie 5193) and it also must have the same state (ie value 7) as before. Then, for each 
image, a process is created that inherits the global/shared state restored in step 308, and each 
o created process is isolated to prevent inter-process state changes. When a process is being 
?s restored, process state is being registered with the kernel, inter-process mechanisms are being 
1 5 O restored and reconnected and I/O buffers in the kernel may be being restored. Some of these 
[fi actions in one process may have the unintended side effect of disturbing another process that is 
* y also being restored. For example if an I/O buffer that is in the operating system as a result of a 
M process x performing a write to a socket connection, then process y could unintentionally be 
p : l delivered an asynchronous signal that notifies it of I/O being present (for reading) prior to the 
20 y process being fully restored. At step 3 14, for each type of state within the processes, the process- 
13 private resources are recreated to their state at the time the snapshot image was taken. If the 
state is virtualized (decision step 316), the system state is bound to a virtual definition. As part 
of the restore an extra step must be done to create a virtual mapping. This is done by taking the 
system resource that was created in step 314 and binding it to the virtual definition that was 
25 saved during the snapshot in step 266. This allows the application to see a consistent view of 
resources, since it cannot be guaranteed that at restore time the exact same system resource will 
be available. If the state is shared with another process, such as via a pipe (decision state 320), 
the shared state is reconnected with the other process at step 322. If there are more states 
(decision step 324) steps 314 through 322 are repeated. Once steps 314 through 322 have been 
30 executed for all states, control continues to step 326, where the process is placed in synchronized 
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wait. If there are remaining images in the snapshot image (decision step 328), steps 310 through 
326 are repeated. Once all images have been processed, control continues to step 330, where 
traces and states induced during restore of the process are removed, and a synchronized resume 
of all processes occurs at step 332. 
5 Once steps 300 through 332 have executed without error on whatever computer the 

restore driver 220 was executed, the restored application can continue to run without 
interruption. Thus, the present invention avoids the overhead and delay of shutting down an 
application, storing data to a separate file, moving both the application and data file elsewhere, 
and restarting the program. 

10 

B . Snapshot Virtual Templating 

In another aspect, the present invention provides a system, method, and computer 

0 program product for creating snapshot virtual application templates for the purpose of 
propagating a single application snapshot into multiple distinct instances. Snapshot virtual 

15 O templates allow multiple application instances to use the same fixed resource ID ("RID") by 
[Pi making the resource ID virtual, privatizing the virtual RID, and dynamically mapping it to a 
v * unique system resource ID. A RID is the identifier assigned to represent a specific system 

1 & resource and acts as a handle when referencing that system resource. Anonymous resources are 
f resources that are read-only or functionally isolated from other applications. Anonymous 

20 s *\ j resources are also shareable resources. An anonymous resource is a non-fixed resource allocated 
P by the operating system and identified by a per-process handle. These are functionally-isolated 
since the operating system allocates it anonymously and one is as food as another. Examples of 
this are non-fixed TCP ports or file descriptors. A resource is said to be network-wide unique if 
there can only be one instance of that resource with its corresponding identifier on computer 

25 network or subnetwork. An example of this is an network IP address (i.e. 10.1.1.1). Snapshot 
virtual templates allow snapshots to be described in a manner that separates shareable data from 
non-salable data. Data is loosely defined to mean any system resource (memory, files, sockets, 
handles, etc.). When a snapshot is cloned from a virtual template, the common or shared data is 
used exactly as is, whereas the non-salable data is either copied-on-write, multiplexed, 

30 virtualized, or customized-on-duplication. The present invention greatly reduces the required 
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administrative setup per application instance. Snapshot virtual templating works by noting 
access to modified resources, fixed system IDs/keys and unique process-related identifies and 
automatically inserting a level of abstraction between these resources and the application. The 
resources contained in a snapshot virtual template can be dynamically redirected at restore time. 
Access to memory and storage is managed in a copy-on-write fashion. System resource handles 
are managed in a virtualize-on-allocate fashion or by a multiplex-on-access mechanism. Process- 
unique resources are managed in a redirect-on-duplicate fashion. Rules may be defined through 
an application configurator that allows some degree of control over the creation of non-salable 
data. 

The application configurator is a software component that resides in the application 
domain and communicates configuration information about the application on its behalf such as 
the DSL specifications. Since this component operates without assistance from the application, it 
may exist in the form of an application library, or may be placed in the applications environment 
(via inheritance at execution time), ir it can be implemented as a server process that proxies 
application information to the operating system as necessary. 

A resource duplicator is a software component that fields requests for non-shareable 
resources and duplicates or virtualizes resources so that applications receive their own private 
copies and can co-exist transparently with multiple instances of the same application forged from 
the same virtual template. The resource duplicator also processes duplication rules fed by the 
application configurator or application snapshot/restore framework 200. 

As used herein, non-salable data refers to any resource that is modified and globally 
visible to other application instances is non-salable (i.e. files). Process-related identifiers that are 
system-wide unique are also non-shareable since conflicts will arise if two instances use the same 
identifier at the same time (uniqueness is no longer preserved). References to unique resources 
by fixed handles (i.e. fixed TCP port numbers or IPC keys) are also not shareable. Memory 
pages that are specific to an application instance (i.e. the stack) are another example of a non- 
shareable resource. For illustrative purposes, examples of non-salable data include application 
config files that must be different per application instance as well as modified application data 
files if the application is not written to run multiple copies simultaneously. Other examples 
include stack memory segments or heap segments may also be non-salable data, shared memory 
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keys that are a fixed value, usage of fixed well-known (to the application) TCP port numbers, 
and process identifiers (two distinct processes cannot share the same PID). 

The snapshot virtual template is constructed automatically by dividing a snapshot process 
into shareable and non-shareable data. The knowledge of which system resources can be shared 
is encoded in the snapshot virtual templating framework itself If an application has non- 
shareable internal resources (as opposed to system resources), it may not be possible to construct 
a virtual-template for that application. 

Snapshot virtual templates are node-independent as well as application-instance 
dependent. Snapshot virtual templates cannot be created for applications that use non-shareable 
physical devices. Snapshot virtual templates must save references to non-shareable resources in 
their pre- customized form, rather than their evaluated form. All access by an application to non- 
shareable resources must be via the operating system. Internal or implicit dependencies by the 
application itself cannot be virtually-templated. A snapshot virtual template may be created from 
an application instance that was originally forged from a different virtual template. 

Snapshot virtual templating is an alternate method of creating an application instance. 
The snapshot restore method described above requires creating unique instances of an application 
to create unique "snapshots" of that application. Virtual templating allows the creation of a 
generic application instance from which unique instances may be spawned. Every unique 
instance that is created from the original virtual template starts out as an exact copy (referred to 
herein as "clone") but has been personalized just enough to make it a fixlly-functioning 
independent copy. Differences between copies may be due to the way resources are named or 
identified. 

FIG. 7 illustrates in block diagram form the contents of a snapshot virtual template. The 
main components are resource name size, resource descriptor size, resource type, resource name, 
and resource data. Resource data includes many different types of information, as illustrated. 

FIG. 8 describes the sequence of steps executed by the application snapshot/restore 
framework 200 to create a snapshot virtual template. As the application runs, every request for 
a new operating system resource (file, memory, semaphore, etc.) is checked for an existing rule. 
When the application is started under the virtual templating framework, a set of rules may be 
supplied at that time. The rule will state the type of resource, the type of access (i.e., create, read, 
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write, destroy, etc), and the action to be taken. If a rule is found (decision step 360), the rule is 
saved as part of the process state and recorded with the resource as auxiliary state at step 362. 
Rules may be added to the template that control the creation of application-instance specific 
resources. For example, environment variables or pathnames that incorporate an AID to 
5 differentiate and customize a particular resource among multiple instances. The following 
syntax created for illustration purposes: 

Define <APPL-ID> as PROPERTY application-ID 

REDIR PATH "/user/app/config" to 'Yusr/app/<APPL-ID>/config" 

1 0 SET ENV "HOME" - "/usr/app/<APPL-ID>" 

If rules are created, they should also be specified via the application configurator. If no 
y rule is found, the resource is checked using a standard set of criteria that determine whether the 
resource needs to be abstracted or virtualized in order to be cloned at step 364. The criteria is 
15 P again checked at steps 366, 370, 372, 378, 380 and 386. In most cases, no action is taken. 
fn Resources are simply classified into their correct types so that when an instance is cloned the 
fe " correct action can be taken. If the resource is shared, i.e. shared memory (decision step 366), the 
H resource is marked as shared (step 368) so that during the subsequent snapshot all references to 
n the shared object will be noted. If the resource can be modified (decision step 370), it must be 
20 isolated from the original during cloning so that the original remains untouched. If the resource 
C3 is a large object and has a notion of an underlying object, such as i.e. mapped memory (decision 
step 372), it is marked for copy-on-write (step 374). Otherwise, the entire resource must be 
duplicated and marked accordingly (step 376). A resource is said to be systemwide unique if the 
identifier used to represent that resource cannot represent more than one instance of that resource 
25 at a single point in time on the same node or computer. If the resource is systemwide unique 
(decision step 378), and is exported as an external interface, as is the case when another client 
application that is not running on the platform has a dependency on the resource, such as a TCP 
port number (decision step 380), it isn't feasible to virtualize access to the resource, so it is 
marked to be multiplexed (step 382). Multiplexing allows multiple independent connections to 
30 transparently co-exist over the same transport using only a single identifiable resource. If it isn't 
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externally exported, the resource is marked for virtualize at step 384. Continuing to decision step 
386, if the resource is network-unique, it is marked for allocation at step 388. Control proceeds 
to step 390, where the resource request is processed. Steps 360 through 390 are repeated for 
every resource request occurring during application execution. 

FIG. 9 illustrates the sequence of steps executed to perform cloning or replication of a 
process from a snapshot virtual template. This sequence of steps can be performed by a 
replication program that creates a new snapshot image from an existing template, or by the 
restore driver 220. When an application instance is restored from a snapshot that is a virtual 
template, a new instance is automatically cloned from the template using the rules that were 
gathered during the creation of the template. For every resource included in the snapshot virtual 
template, rules for the resource and access type are looked up. Any resource that requires special 
handling as part of the templating effort has the rule described inside the snapshot template as 
3 part of the auxiliary state associated with the resource. If no rule is found (decision step 400), the 
resource is recreated using the existing saved information in the snapshot (step 402). Otherwise, 
if a resource is marked for duplicate (decision step 404), then a copy of the original resource is 
made at step 406. If a resource is marked for copy-on-write (decision step 408), then at step 410 
a reference to the original underlying object (in the original template) is kept, and any 
modifications to the original force a copy-on-write action so that the modifications are kept in an 
application-instance private location and the two form a composite view that is visible to the 
application instance. 

If a resource is marked for virtualization (decision step 412), the original resource is 
allocated or duplicated in blank form at step 414. At step 416, the resource is mapped 
dynamically to the new resource at run-time by binding the system resource to the saved resource 
in the snapshot image. If a resource is marked for multiplex (decision step 418), the original 
resource is duplicated and then spliced among other application instances that share it (step 420). 
If the resource is a network unique resource (decision step 422), a unique resource must be 
allocated (step 424) by communicating with another component of the network, i.e. network map 
or registry, that assigns a resource to this instance. Then this new resource is bound to the fixed 
resource that was saved in the virtual template (step 426), in a manner similar to virtualization. 
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C. Virtual Resource ID Mapping 

The present invention provides virtual mapping of system resource identifiers in use by a 
software application for the purpose of making the running state of an application node 
independent. By adding a layer of indirection between the application and the resource, new 
system resources are reallocated and then can be mapped to the application's existing resource 
requirements while it is running, without the application detecting a failure or change in resource 
handles. 

This layer of indirection makes the application's system RID transparent to the 
application. RID's are usually numeric in form, but can also be alphanumeric. RID's are unique 
to a machine, and can be reused once all claims to a specific RID have been given up. Some 
examples of RID's include process ID's, shared memory ID's, and semaphore ID's. Only the 
virtual RID is visible to the application. Conversely, the virtual RID is transparent to the OS, 
and only the system RID is visible to the OS. Every application has a unique identifier that 
distinguishes it from every other running application. There exists a one to one mapping 
between the AID: resource type: virtual RID combination and the node ID: system RID. Virtual 
RID's are only required to be unique within their respective applications, along with their 
corresponding system RID's may be shared among multiple programs and processes that have 
the same AID. System RID's that have been virtualized are accessed through their virtual ID's to 
ensure consistent states. 

AID's are farm-wide unique resources and are allocated atomically by the AID generator. 
Because in the present invention applications aren't uniquely bound to specific names, process 
ID's, machine hostnames or points in time, the AID is the sole, definitive reference to a running 
application and its processes. Typically, an AID is defined in reference to a logical task that the 
application is performing or by the logical user that is running the application. 

Virtual resource mapping comprises several basic steps: application registration, 
allocation of the RID, and resolution of the RID. During registration of the application, the AID 
is derived if preallocated or the application existed previously, or it may be allocated 
dynamically by an ATP generator. The AID is then made known for later use. Allocation of a 
RID happens when an application requests access to a system resource (new or existing) and the 
OS returns a handle to a resource in the form of a RID. The virtual resource layer intercepts the 
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system returned RID, allocates a virtual counterpart by calling the resource specific resource 
allocator, establishes mapping between the two, and returns a new virtual RID to the application. 

Resolution of a RID may occur in two different directions. A RID may be passed from 
the application to the OS, in which case the RID is mapped from virtual ID to system ID. 
Conversely, the RID may be passed from the OS to the application, in which case the transition 
is from system ID to virtual ID. Requests for translation are passed from the framework to the 
virtual RID translation unit and the corresponding mapping is returned once it has been fetched 
from the appropriate translation table. Multiple translation tables may exist if there are multiple 
resource types. 

FIG. 10 illustrates the steps executed to register an application. The AppShot harness 
500 exists to aid in the creation of the appropriate runtime environment for the application prior 
to launching the application. The appshot harness 500 initializes the runtime environment for an 
application by first priming its own environment with the appropriate settings and then launching 
the application which inherits all these settings. The appshot harness 500 is provided because the 
application cannot be recompiled or rewritten to initialize its own environment. Some of the 
settings that are established by the appshot harness 500 include the AID, assigned process ID 
range, DSL specifications, application virtual ID's, and snapshot templating rules. The DSL 
specifications are registered as part of the environment. A process is an in-memory instantiation 
of a software program. Process x is the in-memory image of the AppShot harness 500 and 
process y is the in-memory image of the application. At step 510, the appshot harness 500 
registers an AID % such as "dbserver." with the application snapshot/restore framework 200 
within the OS kernel 206. The application snapshot/restore framework 200 then creates virtual 
translation tables 502 for the AID at step 512. Virtual translation tables 502 are data units that 
contain translation information related to RID's, such as AID's or process ID's, virtual RID's, 
and system RID's. Separate tables can be implemented per resource type or a table can be shared 
if a unique resource type is stored per table entry. A translation unit maps the system RID's to 
the virtual RID's by storing and fetching translation information in the appropriate translation 
table. Once the virtual translation tables 502 are created, Process x is linked to the AID a i at step 
514. At this point, process y is created when the appshot harness 500 launches the application at 
step 516. Process y then inherits processes link to % and its tables at step 518. 
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FIG. 1 1 shows the allocation of a virtual resource such as a semaphore in accordance with 
the present invention. At step 520, an application requests that a semaphore resource is allocated 
for its process y . In response (step 522), the application snapshot/restore framework 200 looks up 
the AID in memory 154, and returns AID \ At step 524, in response to a request from the 
5 application snapshot/restore framework 200, the system semaphore pool returns semaphore s { . 
At step 526, the application snapshot/restore framework 200 scans the virtual resource 
translation table 502 for an available slot and allocates the virtual semaphore. At step 528, the 
application snapshot/restore framework 200 inserts the translation s { = a i :v 3 and the virtual 
resource translation table 502 now contains the mapping. At step 530, the virtual semaphore v 3 
10 is returned to the application. 

FIG. 12 illustrations translation of a virtual resource to a system resource in accordance 
with the present invention. At step 532, the application calls the semaphore interface and 
w supplies the virtual RID v 3 to the application snapshot/restore framework 200. At step 534, the 
r ii application snapshot/restore framework 200 looks up the AID for the calling application and 
15 returns At step 536, the application snapshot/restore framework 200 then looks up the 
fjl translation for a^ in the virtual resource translation table 502, which returns s { at step 538. At 
step 540, the OS semaphore implementation is achieved when the application snapshot/restore 
I* framework 200 forwards the application's request by substituting s { for v 3 . 
O FIG. 13 illustrates translation of a system resource to a virtual resource. Beginning at 

20 step 542, the application calls the semaphore interface and expects the RID as a result. At step 
u 544, the application snapshot/restore framework 200 looks up the AID for the calling application 
and returns a { . At step 546, the application snapshot/restore framework 200 forwards the 
application request to the OS semaphore implementation, which returns the system semaphore s { 
at step5 48. At step 550, the application snapshot/restore framework 200 then looks up the 
25 translation for a^ in the virtual resource translation table 502, which returns v 3 at step 552. At 
step 554, the application snapshot/restore framework 200 returns the virtual RID v 3 to the calling 
application. 

FIG. 14 illustrates the logical sequence of steps executed to create the virtual translation 
table 502. Beginning at step 556, and attempt is made to register AID a^ If the AID hasn't 
30 already been registered (decision step 558), a virtual resource translation table space for % is 
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created in table 502 (step 560). Translation tables are then added for each type of resource 
associated with the application at step 562. At step 564, the process x is linked to a^ At step 566, 
the process y is created and the application is launched. Steps 568 and 570 show the parallel paths 
of execution. The flow of control continues on to step 568 and halts shortly thereafter. The new 
flow of execution continues on from 566 to 570, where the process inherits context from the 
process at step 568. 

FIG. 15 illustrates in greater detail the sequence of steps executed to translate a virtual 
resource. For illustrative purposes, the resource in this example is a semaphore. Beginning at 
decision step 580, if an AID is found upon lookup, and the interface uses the RID as a parameter 
(decision step 582), the application snapshot/restore framework 200 performs a lookup of the 
translation for a,:vjat step 584. If a system resource Sj is found, the system RID is substituted for 
the virtual RID at step 586 and passed to the semaphore interface of the OS 206 (step 588). If 
the semaphore was not allocated by the semaphore interface (decision step 590), and the 
interface returns a semaphore (decision step 592) control proceeds to step 594 where a reverse 
lookup for the translation of the AID with a system RID is performed. The returned virtual RID 
is then substituted for the virtual ID at step 596. Returning to decision step 590, if a semaphore 
was allocated by the semaphore interface, control proceeds to step 598 where the virtual 
semaphore is allocated and a translation for v 2 = a^ is inserted into the translation table 502 at 
step 600. V 2 is then substituted for s 2 at step 602. 

In another aspect, the present invention provides communication between at least two 
applications through virtual port multiplexing. The communication is achieved by accepting a 
connection from a second application on a first port and allocating a second port to receive the 
communication from the second application. Once the second port has been allocated the second 
port translation is recorded. The communication is sent to the first port from the second 
application and received on the second port. The communication is then delivered to a first 
application from the second port. In one embodiment the first application requests the 
communication from the first port and the first port is translated to determine the second port 
such that the communication is delivered to the first application in the step of delivering the 
communication to the first application. 

In one embodiment, the communication is received on the first port following the step of 
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sending the data to the first port, the first port is translated to determine the second port prior to 
the step of receiving the communication on the second port, and the step of receiving the 
communication on the second port includes queuing the communication on the second port from 
the first port. 

In one embodiment, the second application requests to connect with the first port prior to 
the step of accepting the connection. Once the second port is allocated, the second port is 
negotiated including negotiating the second port between a first and second virtual port 
multiplexer. Further, the second application is connected with the second port following the step 
of allocating the second port. The step of recording the translation including, first, recording the 
translation of the second port in association with the first application, and second, recording the 
translation of the second port in association with the second application. 

The present invention also provides for a dynamic symbolic link (DSL) and the resolution 
of that DSL. The pathname of a first application is renamed to a target pathname, a variable 
within the target pathname, the first pathname is defined as a symbolic link and the symbolic link 
is associated with a virtual pathname. The method and apparatus further defines a specification 
is further defined that is associated with the virtual pathname including associating the variable 
with the virtual pathname. In associating the symbolic link with the virtual pathname, a 
declaration is defined within the virtual pathname. 

Having disclosed exemplary embodiments and the best mode, modifications and 
variations may be made to the disclosed embodiments while remaining within the scope of the 
present invention as defined by the following claims. 
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CLAIMS 

What is claimed is: 

1 . In a computer network, a method of implementing a virtual layer around a software 
application instance in communication with an operating system, the method comprising the 
steps of: 

(a) registering an application by associating a unique application identifier to the application, 
said association and passing said association to a software module that processes transactions 
between the application and the operating system; 

(b) allocating a resource identifier when an application requests access to a system resource, 
said resource identifier returned from the operating system in response to said request; and 

(c) translating a resource identifier from a system resource identifier to a virtual resource 
identifier when the resource identifier is passed from the operating system to the application. 

2. In a computer network, a method of implementing a virtual layer around a software 
application instance in communication with an operating system, the method comprising the 
steps of: 

(a) registering an application by associating a unique application identifier to the application, 
said association and passing said association to a software module that processes transactions 
between the application and the operating system; 

(b) allocating a resource identifier when an application requests access to a system resource, 
said resource identifier returned from the operating system in response to said request; and 

(c) translating a resource identifier from a virtual resource identifier to a system resource 
identifier when the resource identifier is passed from the application to the operating system. 
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ABSTRACT 

The present invention provides virtual mapping of system resource identifiers in use by a 
software application for the purpose of making the running state of an application node 
independent. By adding a layer of indirection between the application and the resource, new 
system resources are reallocated and then can be mapped to the application's existing resource 
requirements while it is running, without the application detecting a failure or change in resource 
handles. This layer of indirection makes the application's system resource identifier (system 
RID) transparent to the application. RID's are usually numeric in form, but can also be 
alphanumeric. RID's are unique to a machine, and can be reused once all claims to a specific 
RID have been given up. 
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I hereby claim the benefit under Title 35, United States Code, § 120 of any United States application(s) listed below 
and, insofar as the subject matter of each of the claims of this application is not disclosed in the prior United States 
application in the manner provided by the first paragraph of Title 3 5 , United States Code, §112,1 acknowledge the 
duty to disclose to the Patent Office all information known to me to be material to patentability as defined in 37 
C.F.R. 1.56 which occurred between the filing date of the prior application and the national or PCT international 
filing date of this application: 



(Application Serial No.) 



(Filing Date) 



(Status) 



1018179 
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FOR PATENT APPLICATION 
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02/93 



I hereby appoint the following attorneys to prosecute this application and to transact all business in the Patent and 
Trademark Office connected therewith: Harold C. Hohbach, Reg. No. 17,757; Aldo J. Test, Reg. No. 18,048; 
Donald N. Macintosh, Reg. No. 20,316; Edward S. Wright, Reg. No. 24,903; David J. Brezner, Reg. 
No. 24,774; Richard E. Backus, Reg. No. 22,701; James A. Sheridan, Reg. No. 25,435; Robert B. Chickering, 
Reg. No. 24,286; Richard F. Trecartin, Reg. No. 31,801; Steven F. Caserza, Reg. No. 29,780; Laura L. 
Kulhanjian, Reg. No. 33,257; Michael A. Kaufman, Reg, No. 32,988; Edward N. Bachand, Reg. No. 37,085; 
R. Michael Ananian, Reg. No. 35,050; Robin M. Silva, Reg. No. 38,304; David C. Ashby, Reg. No. 36,432; 
and Maria S. Swiatek, Reg. No. 37,244 ; provided that if any one of said attorneys ceases being affiliated with 
the law firm of Flehr, Hohbach, Test, Albritton & Herbert as partner, employee or of counsel, such attorney's 
appointment as attorney and all powers derived therefrom shall terminate on the date such attorney ceases being 
so affiliated. 

Direct all telephone calls to David C. Ashbv at (650) 494-8700. 



Address all correspondence to: 



FLEHR HOHBACH TEST 
ALBRITTON & HERBERT LLP 
Suite 3400, Four Embarcadero Center 
San Francisco, California 941 1 1 



File No. A-69623/DCA/JWC 



I hereby declare that all statements made herein of my own knowledge are true and that all statements made on 
information and belief are believed to be true; and further that these statements were made with the knowledge that 
willful false statements and the like so made are punishable by fine or imprisonment, or both, under Title 18, United 
States Code, §1001 and that such willful false statements mayjeopardize the validity of the application or any patent 
issued thereon. 



Full name of first 
inventor 

Inventor's signature: 
Date: 

Residence: 



Burton A. Hipp 



4117 E. Haack Ct„ Elk Grove. CA 95758 



Citizenship: 

Post Office Address: 



USA 



Same as above 



Full name of second 
inventor 

Inventor's signature: 
Date: 

Residence: 

Citizenship: 

Post Office Address: 



Raieev Bharadhwai 



1405 Redwood Drive, Los Altos. CA 94024 



USA 



Same as above 



1018179 



DECLARATION AND POWER OF ATTORNEY 
FOR PATENT APPLICATION 
Page 2 



02/93 



19 

m 
m 
a 
m 
m 
w 

u 

in 

C3 
O 



Full name of third 
inventor 

Inventor's signature: 
Date: 

Residence: 

Citizenship: 

Post Office Address: 

Full name of fourth 
inventor 

Inventor's signature: 
Date: 

Residence: 

Citizenship: 

Post Office Address: 



m 'on 

■I? ©Bed 



William C, Romans 



660 Evergreen Street. Menlo Park. CA 94025 
USA 



Same as above 



Yuh-veriYeh 



4998 Harmony Way, San Jose. CA 95130 



USA. 



Same as above 
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DECLARATION AND POWER OF ATTORNEY 
FOR PATENT APPLICATION 



As a below-named inventor, I hereby declare that: 

My residence, post office address and citizenship are as stated below next to my name, 

I believe I am the original, first and sole inventor (if only one name is listed below) or an original, first and joint 
inventor (if plural names are listed below) of the subject matter which is claimed and for which a patent is sought 
on the invention entitled VIRTUAL RESOURCE ID MAPPING, the specification of which 

, , , , £~\ is attached hereto, 
(check one) "— 1 

| — | was filed on as 



Application Serial No. 



and was amended on 



(if applicable) 

I hereby state that I have reviewed and understand the contents of the above-identified specification, including the 
claims, as amended by any amendment referred to above. 

I acknowledge the duty to disclose to the Patent Office all information known to me to be material to patentability 
as defined in 37 C.F.R. 1.56. 

I hereby claim foreign priority benefits under Title 35, United States Code, § 1 19 of any foreign application(s) for 
patent or inventor's certificate listed below and have also identified below any foreign application for patent or 
inventor's certificate having a filing date before that of the application on which priority is claimed: 

Prior Foreign Application(s) Priority Claimed 

□ □ 

(Number) (Country) (Day/Month/Year Filed) Yes No 

□ □ 

(Number) (Country) (Day/Month/Year Filed) Yes No 

I hereby claim the benefit under Title 35, United States Code, §1 19(e) of any United States provisional 
application(s) listed below. 

60/157,727 10/5/99 Pending 



(Application Serial No.) (Filing Date) (Status) 
60/157.728 10/5/99 Pending 



(Application Serial No.) (Filing Date) (Status) 
60/157.729 10/5/99 Pending 



(Application Serial No.) (Filing Date) (Status) 
60/157,833 10/5/99 Pending 



(Application Serial No.) (Filing Date) (Status) 
60/157.834 10/5/99 Pending 



(Application Serial No.) (Filing Date) (Status) 

I hereby claim the benefit under Title 35, United States Code, § 120 of any United States application(s) listed below 
and, insofar as the subject matter of each of the claims of this application is not disclosed in the prior United States 
application in the manner provided by the first paragraph of Title 35, United States Code, §112,1 acknowledge the 
duty to disclose to the Patent Office ail information known to me to be material to patentability as defined in 37 
C.F.R. 1.56 which occurred between the filing date of the prior application and the national or PCT international 
filing date of this application: 



(Application Serial No.) (Filing Date) (Status) 
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I hereby appoint fee following attorneys to prosecute this application and to transact all business in ihe Patent and 
Trademark Office connected therewith: Harold C, Hohbach, Reg. No. 17,757; Aldo J. Teat, Reg, No, 18,043; 
Donald N. Macintosh, Reg. No. 20,316; Edward S. Wright, Reg* No. 24,903; David J. Brezner, Reg. 
No. 24,774; Richard E. Backus, Reg. No. 22,701; James A. Sheridan, Reg. No. 25,435; Robert B, Checkering. 
Reg. No. 24,286; Richard P, Trecartin, Reg. No. 31,801; Steven F. Caserza, Reg. No, 29,780; Laura L. 
Kulhanjian, Reg, No. 33,257; Michael A. Kaufman, Reg. No. 32 ,985; Edward N. Bachand, Reg. No. 37,085; 
R. Michael Ananian, Reg. No. 35,050i Robin M. Silva, Reg. No. 38,304; David C. Ashby, Reg. No. 36,432; 
and Maria S. Swiatdc, Reg, No. 37,244 ; provided that if any one of said attorneys ceases being affiliated with 
the law firm of Fiehr, Hohbach, Test, Albritton & Herbert as partner, employee or of counsel, such attorney's 
appointment as attorney and all powers derived therefrom shall terminate on the date such attorney ceases being 
so affiliated. 

Direct all telephone calls t o David G Ashbv at (650) 494-8700. 
Address all correspondence to: 

FLEHR HOHBACH TEST 
ALBRITTON & HERBERT LLP 
Suite 3400, Four Embarcadero Center 
San Francisco, California 941 1 1 

File No. A-69623/DCA/JWC 



I hereby declare that all statements made herein of my own knowledge are true and that all statements made on 
information and belief are believed to be true; and further that these statements were made with the knowledge that 
willful false statements and the like so made are punishable by fine or imprisonment or both, under Title 18, United 
States Code, § 1001 and that such willful false statements may jeopardize the validity of the application or any patent 
issued thereon. 

Full name of first 



inventor 

Inventor's signature: 
Date: 

Residence: 

Citizenship: 

Post Office Address: 



Burton A. Hipp 




4117 & Haaric Ct.. Elk Grove. CA 95758 



USA 



Same as above 



Full name of second 
inventor 

Inventor's signature: 
Date: 

Residence: 

Citizenship: 

Post Office Address: 



Raieev Bharadhwaj 



1405 Redwood Drive. Los Altos. CA 94024 



USA 



Same as above 
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Full name of third 
inventor 

Inventor's signature: 
Date: 

Residence: 

Citizenship: 

Post Office Address: 

Full name of fourth 
inventor 

Inventor's signature: 
Date: 

Residence: 

Citizenship: 

Post Office Address: 



William C Romans 



660 Evergreen Street, Menlo Park, CA 94025 

USA 

Same as above 



Yuh-ven Yeh 



4998 Harmony Way, San Jose, CA 95130 
USA 



Same as above 
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DECLARATION AND POWER OF ATTORNEY 
FOR PATENT APPLICATION 



As a below-named inventor, I hereby declare that: 

My residence, post office address and citizenship are as stated below next to my name, 

I believe I am the original, first and sole inventor (if only one name is listed below) or an original, first and joint 
inventor (if plural names are listed below) of the subject matter which is claimed and for which a patent is sought 
on the invention entitled VIRTUAL RESOURCE ID MAPPING, the specification of which 



(check one) 



$~~\ is attached hereto. 
| — | was filed on 



as 



Application Serial No. 



and was amended on . 



(if applicable) 

I hereby state that I have reviewed and understand the contents of the above-identified specification, including the 
claims, as amended by any amendment referred to above. 

I acknowledge the duty to disclose to the Patent Office all information known to me to be material to patentability 
as defined in 37 C.F.R. 1.56. 

I hereby claim foreign priority benefits under Title 35, United States Code, § 1 19 of any foreign application(s) for 
patent or inventor's certificate listed below and have also identified below any foreign application for patent or 
inventor's certificate having a filing date before that of the application on which priority is claimed: 



Prior Foreign Application(s) 



(Number) 



(Number) 



(Country) 



(Country) 



(Day/Month/Year Filed) 



(Day/Month/Year Filed) 



Priority Claimed 

□ □ 

Yes No 

□ □ 

Yes No 



I hereby claim the benefit under Title 35, United States Code, §1 19(e) of any United States provisional 
application(s) listed below. 

Pending 



60/157.727 


10/5/99 


(Application Serial No.) 


(Filing Date) 


60/157.728 


10/5/99 


(Application Serial No.) 


(Filing Date) 


60/157.729 


10/5/99 


(Application Serial No.) 


(Filing Date) 


60/157.833 


10/5/99 


(Application Serial No.) 


(Filing Date) 


60/157.834 


10/5/99 


(Application Serial No.) 


(Filing Date) 



(Status) 
Pending 



(Status) 
Pending 



(Status) 
Pending 



(Status) 
Pending 



(Status) 

I hereby claim the benefit under Title 35, United States Code, § 120 of any United States applications) listed below 
and, insofar as the subject matter of each of the claims of this application is not disclosed in the prior United States 
application in the manner provided by the first paragraph of Title 35, United States Code, § 1 12, 1 acknowledge the 
duty to disclose to the Patent Office all information known to me to be material to patentability as defined in 37 
C.F.R. 1.56 which occurred between the filing date of the prior application and the national or PCT international 
filing date of this application: 



(Application Serial No.) 



(Filing Date) 



(Status) 



1018179 
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I hereby appoint the following attorneys to prosecute this application and to transact all business in the Patent and 
Trademark Office connected therewith: Harold C, Hohbach, Reg. No. 17,757; Aldo J. Test, Reg. No. 18,048; 
Donald N. Macintosh, Reg. No. 20,316; Edward S. Wright, Reg. No. 24,903; David J. Brezner, Reg. 
No. 24,774; Richard E. Backus, Reg. No. 22,701; James A. Sheridan, Reg. No. 25,435; Robert B. Chickering, 
Reg. No. 24,286; Richard F. Trecartin, Reg. No. 31,801; Steven F. Caserza, Reg. No. 29,780; Laura L. 
Kulhanjian, Reg. No. 33,257; Michael A. Kaufman, Reg. No. 32,988; Edward N. Bachand, Reg. No. 37,085; 
R. Michael Ananian, Reg. No. 35,050; Robin M. Silva, Reg. No. 38,304; David C. Ashby, Reg. No. 36,432; 
and Maria S. Swiatek, Reg. No. 37,244 ; provided that if any one of said attorneys ceases being affiliated with 
the law firm of Flehr, Hohbach, Test, Albritton & Herbert as partner, employee or of counsel, such attorney's 
appointment as attorney and all powers derived therefrom shall terminate on the date such attorney ceases being 
so affiliated. 

Direct all telephone calls to David C. Ashbv at (650) 494-8700. 
Address all correspondence to: 

FLEHR HOHBACH TEST 
ALBRITTON & HERBERT LLP 
Suite 3400, Four Embarcadero Center 
San Francisco, California 941 1 1 

File No. A-69623/DCA/JWC 

I hereby declare that all statements made herein of my own knowledge are true and that all statements made on 
information and belief are believed to be true; and further that these statements were made with the knowledge that 
willful false statements and the like so made are punishable by fine or imprisonment, or both, under Title 1 8, United 
States Code, §1001 and that such willful false statements may jeopardize the validity of the application or any patent 
issued thereon. 

Full name of first 

inventor Burton A. Hipp 

Inventor's signature: 

Date: 



Residence: 4117 E. Haack Ct., Elk Grove, CA 95758 
Citizenship: USA 



Post Office Address: Same as above 



Full name of second 

inventor Raieev Bharadhwai 

Inventor's signature: 

Date: 



Residence: 1405 Redwood Drive, Los Altos. CA 94024 
Citizenship : USA 



Post Office Address: Same as above 
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FuU name of fourth 
investor 

Inventort wgnatw*- 
DUe: 

Residence; 

Citizenship: 

Post Office Address: 



FROM I Romans Barsar-nian > FAX NO. : +1 650 322 4499 

-OCT. 5. 2000" 9:32AM FLEHR HOHBACH TEST 



Fulliuzne of third 
inventor 

Inventor's signature: 
Date: 

Residence: 

Citizenship: 

Post Office Addxess; 



Oct. 05 2000 11 :35AM P3 



g^^fi above. 



Yuh.vciiYeh- 



*QOf Harmony Way losa. CA 95I3CL 

USA - 



gfl^pe at Above 
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